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METHOD OF ALLOCATING PHYSICAL MEMORY SPACE 
HAVING PINNED AND NON- PINNED REGIONS 

FIELD OF THE INVENTION 
5 This invention is concerned with computing 

devices, and is more particularly concerned with physical 
memory management in computing devices. 

BACKGROUND OF THE INVENTION 

10 According to conventional practice, pinned memory 

requests and non-pinned memory requests are allocated in an 
interspersed fashion within physical memory resources such 
as random access memory (RAM) . As is familiar to those who 
are skilled in the art, pinned memory requests are requests 

15 for a block of memory which must be contiguous and cannot be 
shifted within the physical memory space after original 
allocation. Pinned memory requests can originate from 
device drivers for PCI devices, direct memory access (DMA) 
engines, or other functionality requiring access to physical 

2 0 memory which cannot be moved once allocated. Non-pinned 

requests may originate from other functions which view 
physical memory through a memory management unit (MMU) , such 
as a microprocessor's and can be allocated in a non- 
contiguous manner and can be moved within the physical 
25 memory space after original allocation. 

A disadvantage of the conventional practice of 
interspersing pinned and non-pinned memory requests is that 
the physical memory space may become fragmented, 
particularly as blocks are allocated and deallocated over 

3 0 time, which may make it difficult to provide large 
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contiguous free spaces in physical memory that may be 
required to accommodate large pinned memory requests. 

SUMMARY OF THE INVENTION 
5 According to an aspect of the invention, a method 

of allocating memory requests in a physical memory space 
defined between a first boundary and a second boundary 
includes allocating non-pinned memory requests from the 
first boundary, and allocating pinned memory requests from 

10 the second boundary. 

A non-pinned region may be provided from the first 
boundary toward the second boundary, and a pinned region may 
be provided from the second boundary toward the first 
boundary, with a free region defined between the non-pinned 

15 region and the pinned region. The non-pinned region is a 

region of the physical memory space in which only non-pinned 
memory requests may be allocated. The pinned region is a 
region of the physical memory space in which or adjacent to 
which pinned memory requests may be allocated. The free 

2 0 region is an unallocated space between the non-pinned region 
and the pinned region. 

The method may further include receiving a pinned- 
memory request, determining whether a hole that accommodates 
the received pinned memory request exists in the pinned 

25 region, allocating the received pinned memory request to the 
hole if such a hole exists, and allocating the received 
pinned memory request in the free region adjacent the pinned 
region if such a hole does not exist. If more than one such 
hole exists, the received pinned memory request may be 

30 allocated to a smallest one of such holes. 
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Within the context of the pinned region, a ''hole" 
shall be understood to mean a contiguous space that is 
either free of memory allocation or is occupied only by one 
or more non-pinned memory blocks . 

A background process may be operated to compact 
the non-pinned region by moving at least one non-pinned 
memory block from an end of the non-pinned region adjacent 
the free region to fill at least one hole in the non-pinned 
region. 

In the context of the non-pinned region, a "hole" 
will be understood to mean a contiguous space that is free 
of memory allocation. 

According to another aspect of the invention, 
there is provided a method of allocating a memory request in 
a physical memory space defined between a first boundary and 
a second boundary. A non-pinned region is provided from the 
first boundary toward the second boundary and a pinned 
region is provided from the second boundary toward the first 
boundary, with a free region being defined between the non- 
pinned region and the pinned region. The method includes 
receiving a pinned memory request, determining that there is 
no hole in the pinned region that accommodates the received 
pinned memory request, determining that the free region is 
not large enough to accommodate the pinned memory request, 
widening the free region by moving a non-pinned memory block 
from an end of the non-pinned region adjacent the free 
region to a hole in the pinned region, and allocating the 
received pinned memory request to the widened free region. 

According to still another aspect of the 
invention, there is provided a method of allocating a memory 
request in a physical memory space defined between a first 
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boundary and a second boundary. A non-pinned region is 
provided from the first boundary toward the second boundary 
and a pinned region is provided from the second boundary 
toward the first boundary, with a free region being defined 
5 between the non-pinned region and the pinned region. The 
method includes the steps of receiving a pinned memory 
request, determining that there is a non-pinned memory block 
in the pinned region that occupies a hole at least as large 
as the received pinned memory request, moving the non-pinned 

10 memory block in the pinned region to free the hole that is 
at least as large as the pinned memory request, and 
allocating the received pinned memory request to the freed 
hole that is at least as large as the received pinned memory 
request . The non-pinned memory block may be moved to the 

15 free region adjacent to the non-pinned region. 

Computer program products may be provided in 
accordance with these and other aspects of the invention. 
Each inventive program product may be carried by a medium 
readable by a computer (e.g., a carrier wave signal, a 

20 floppy disc, a hard drive, a random access memory, etc.). 

The methods of handling memory allocation requests 
in accordance with the invention provide for improved 
efficiency in memory management, including reduced 
fragmentation of the physical memory space and improved 

2 5 ability to provide large contiguous spaces to accommodate 
large pinned memory requests. 

Other objects, features and advantages of the 
present invention will become more fully apparent from the 
following detailed description of the preferred embodiments, 

30 the appended claims and the accompanying drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a schematic illustration of a technique 
for organizing physical memory in accordance with the 
invention; 

FIG. 2 is a view similar to FIG. 1, showing a 
condition of the physical memory after a period of time in 
which memory requests have been allocated and deallocated; 

FIG. 3 is a simplified block diagram of a 
computing device in which the present invention may be 
applied; 

FIGS. 4A and 4B together form a flow chart that 
illustrates a process for handling a non-pinned memory 
request in accordance with the invention; 

FIGS, 5A-5D together form a flow chart that 
illustrates a process for handling a pinned memory request 
in accordance with the invention; and 

FIG. 6 is a flow chart that illustrates a process 
carried out in background to compact the non-pinned memory 
region. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

FIG. 1 is a schematic illustration of a manner of 
organizing physical memory in accordance with the invention. 
In FIG. 1, reference numeral 100 generally indicates a 
physical memory space. The physical memory space 100 is 
defined between a first boundary 180 and a second boundary 
190. A non-pinned memory region 110 (also referred to as a 
^^non-pinned region") extends from the first boundary 180 
toward the second boundary 190. A pinned memory region 130 
(also referred to as a "pinned region") extends from the 
second boundary 190 toward the first boundary 180. A free 
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memory region 120 (also referred to as a "free region") is 
defined between the non-pinned region 110 and the pinned 
region 13 0. The non-pinned region is a region of the 
physical memory space in which only non-pinned memory 
requests may be allocated. The pinned region is a region of 
the physical memory space in which or adjacent to which 
pinned memory requests may be allocated. The free region is 
an unallocated space between the non-pinned region and the 
pinned region. 

Pointers 160 and 140 respectively indicate the 
beginning and the end of the non-pinned region 110. 
Pointers 170 and 150 respectively indicate the beginning and 
the end of the pinned region 130. In general, at the 
beginning of an allocation process non-pinned memory 
requests are allocated from the first boundary 18 0 so that 
the non-pinned region 110 grows into the free region 120. 
Also, pinned memory requests are allocated from the second 
boundary 190 so that the pinned region 13 0 grows into the 
free region 12 0. 

FIG. 2 is a view similar to FIG. 1, showing a 
condition of the physical memory space 100 after allocations 
and deallocations of memory requests have occurred over a 
period of time. It will be noted that the pinned memory 
region 13 0 now includes a mixture of pinned and non-pinned 
memory blocks. Meanwhile, the free region 120 continues to 
be available to accommodate large pinned memory requests. 
Specific processes for handling memory allocation requests 
in accordance with the invention which result in the 
condition shown in FIG. 2 will be described below. 

FIG, 3 is a simplified block diagram of a 
computing device 300 in which the present invention is 



ROC920010098US1 

applied. The computing device 3 00 may be a computer or any 
other device which utilizes random access memory (RAM) . 

The computing device 300 includes a central 
processing unit (CPU) 310, a memory controller 320, volatile 
5 memory (e.g., RAM) 330, non-volatile memory 340 and 

input/output (I/O) adapters 350 and 360. A processor bus 
370 interconnects the CPU 310 and the memory controller 320. 
A memory bus 3 80 interconnects the memory controller 32 0 and 
the volatile memory 330 and the non-volatile memory 340. A 
10 PCI bus 390 interconnects memory controller 320 with l/O 
adapters 350, 360. 

All of the hardware making up the computing device 

3 00 may be conventional. 

The CPU 310 includes a Memory Management Unit 

15 (MMU) which is not separately shown. The MMU allows 

instructions running in the CPU 310 to use virtual addresses 
which are translated into physical addresses by the MMU. 
The MMU divides the virtual and physical address ranges into 
individual units called pages, which may or may not be of 

20 fixed length. A typical page length is 4096 bytes. The 
physical addresses are mapped to portions of the volatile 
memory 330 or the non-volatile memory 340. 

Allocation of virtual memory appears as a 
contiguous set of pages, or memory addresses, to the 

25 instructions running in the CPU 310, but may be mapped to 

non- contiguous physical pages by the MMU. This permits the 
physical page to which a virtual page is mapped to be 
changed without affecting the instructions which use the 
virtual page. Consequently, memory blocks allocated in this 

3 0 way are said to be "non-pinned". 
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The I/O adapters 3 50, 3 60 are generally not privy 
to the mapping of virtual to physical addresses performed by 
the MMU of the CPU 310. Consequently, pages in volatile 
memory 33 0 or non-volatile memory 340 which are accessed by 
the I/O adapters 350, 360 in addition to the CPU 310 must 
not be moved while the I/O adapters are accessing the pages. 
In such cases, the physical page location of a fixed virtual 
to physical page mapping is said to be "pinned" . The buffer 
space in memory required by an I/O adapter 350, 360 often 
spans several pages and because the I/O adapter deals 
directly with the physical addresses, these pages are 
generally required to be contiguous. 

The memory management techniques of the present 
invention, as described herein, accommodate the need for 
pinned memory allocations, while utilizing the physical 
memory in an efficient manner. 

FIGS. 4A and 4B together form a flow chart that 
illustrates handling of a request for a non-pinned memory 
allocation. 

Initially, when a request for a non-pinned memory 
block is received, a virtual memory range is allocated (step 
410). It is then determined, at decision block 420, whether 
there are a sufficient number of free pages within the non- 
pinned region 110 (FIG. 1) which have been freed through 
prior deallocations. If such is the case, then the number 
of needed pages is allocated from the non-pinned region 110, 
as indicated at block 480 in FIG. 4A. Then, as indicated by 
block 490, the physical pages allocated at block 480 are 
mapped to the virtual memory space allocated at block 410. 

Referring again to decision block 420, if it is 
found that there is not a sufficient number of free pages in 
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the non-pinned region, then decision block 430 follows 420. 
At decision block 430 it is determined whether there is a 
sufficient number of free pages in the non-pinned region 110 
and the free region 120, combined. If so, block 450 
5 follows, at which any free pages within the non-pinned 
region are first allocated. Then block 460 is performed. 
At block 460, the remaining needed pages are allocated from 
the free region 120. The pages allocated from the free 
region are a set of contiguous pages starting with the page 

10 pointed to by the end of non-pinned region pointer 140 (FIG. 
1) . Then, at block 470, the end of non-pinned region 
pointer 14 0 is moved to include the pages allocated from the 
free region at block 460. Following block 470 is block 490, 
at which the allocated physical memory pages are mapped to 

15 the virtual memory space allocated at block 410. 

Referring again to decision block 430, if it is 
determined in that block that there is not a sufficient 
number of free pages in the non-pinned and free regions, 
then decision block 432 follows. At decision block 432 it 

20 is determined whether there is a sufficient number of pages 
for the received non-pinned memory request in the non- 
pinned, pinned and free regions. If not, the memory 
allocation fails (block 434) and a suitable message is 
issued. 

25 However, if it is determined at block 432 that 

there is a sufficient number of free pages in the non- 
pinned, pinned and free regions combined, then block 43 6 
follows block 432. In block 436 any free pages from the 
non-pinned region are allocated first. Then, at block 438, 

3 0 any free pages in the free region are allocated. (If 

necessary, the end of non-pinned region pointer 140 is moved 

9 
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to reflect the newly allocated pages from the free region 
120 (block 440).) Then, as indicated in block 442, any 
needed remaining pages are allocated from the pinned region 
130. Following block 442 is block 490 at which the physical 
pages that have just been allocated are mapped to the 
virtual memory space that was allocated at block 410. 

From the foregoing it will be understood that non- 
pinned memory allocation requests may be allocated using any 
unallocated space in the physical memory space, but with 
space allocated in the following order of preference: first 
the non-pinned region, second the free region, and the 
pinned region last. Allocations from the free region are 
made beginning from the end of non-pinned region pointer 140 
toward the end of pinned region pointer 150, and the end of 
non-pinned region pointer 140 is shifted to reflect the 
allocation from the free region. 

FIGS. 5A-5D together form a flow chart that 
illustrates processes in accordance with the invention for 
handling pinned memory allocation requests. 

Initially, when a request for a pinned memory 
block is received, a virtual memory range is allocated, as 
indicated at block 502. Then, at decision block 504, it is 
determined if there is a sufficient number of free 
contiguous pages in the pinned region 130. In other words, 
it is determined whether there is any unoccupied hole of 
adequate size in the pinned region. If so, then block 512 
follows. At block 512, the set of contiguous pages which 
best fits the number of contiguous pages requested is 
allocated. 

By "best fit" it will be understood that the 
smallest hole of adequate size is used. Following block 512 

10 
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is block 514, at which the physical memory space which has 
just been allocated is mapped to the virtual memory space 
allocated at block 502, 

If a negative determination is made at block 504, 
5 then decision block 506 follows block 504. At block 506 it 
is determined whether there is a sufficient number of 
allocated contiguous non-pinned pages (including adjacent 
unallocated space) within the pinned region to satisfy the 
received request. I.e., it is determined whether an 

10 adequate "hole" occupied or partially occupied by a non- 
pinned block or blocks exists in the pinned region. If so, 
then decision block 507 follows block 506. At decision 
block 507 it is determined whether there is a sufficient 
number of free pages in the non-pinned and free regions to 

15 accommodate moving the non-pinned pages in the identified 
hole from the pinned region. If such is the case, then 
block 508 follows. At block 508 the non-pinned pages of the 
identified hole are moved from the pinned region to the non- 
pinned region and also to the free region if necessary. 

20 Then, at block 510, the newly freed pages within the pinned 
region are allocated to the memory request. Following block 
510 is block 514, at which the allocated physical pages are 
mapped to the virtual memory space allocated at block 502. 

If a negative determination was made at block 507, 

25 then the memory allocation fails (block 522, FIG. 5C) and a 
suitable message is sent. 

The processing involved in decision blocks 504, 
506 and 507 may be arranged such that, if the best fit for 
the received pinned memory allocation request is in a hole 

3 0 that is occupied or partially occupied by non-pinned pages, 
and if there are sufficient free pages to move the non- 
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pinned pages to the non-pinned region and/or the free region 
(or elsewhere in the pinned region), then the best-fitting 
occupied hole is used instead of the best-fitting non- 
occupied hole. 

5 Considering again decision block 506, if a 

negative determination is made at that block, then decision 
block 516 (FIG. 5C) follows. At decision block 516 it is 
determined if there is a sufficient number of pages within 
the free region 120 to satisfy the received pinned memory 
10 allocation request. 

If so, block 524 follows. At block 524 the number 
of needed pages is allocated from the free memory region. 
The pages allocated from the free memory region are a set of 
contiguous pages starting with the page pointed to by the 
15 end of pinned region pointer 150. Next, as indicated at 
block 526, the end of pinned region pointer 150 is updated 
to include the pages allocated from the free memory region. 
Block 52 6 is followed by block 514, at which the allocated 
physical memory pages are mapped to the virtual memory space 
20 allocated at block 502. 

If a negative determination is made at block 516, 
then decision block 518 follows. At decision block 518 it 
is determined whether there is a sufficient number of pages 
in the free region plus free pages in the non-pinned region 
25 to satisfy the received pinned memory allocation request. 

If so, then block 528 follows 518. At block 528 pages from 
the end of the non-pinned region are moved to fill holes 
starting from the beginning of the non-pinned region 110, 
thereby widening free region 120. Then block 530 follows. 
30 At block 530 the end of non-pinned region pointer is updated 
to exclude the pages that were moved at block 528. 

12 
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Following block 530 is block 532. At block 532 the pages 
needed for the received pinned memory allocation request are 
allocated from the now- widened free memory region. Then, at 
block 534, the end of pinned region pointer 150 is updated 
to include the pages allocated at block 532. 

Following block 534 is block 514, at which the 
allocated physical memory pages are mapped to the virtual 
memory space allocated at block 502. 

Considering again block 518, if a negative 
determination is made at that block, then decision block 520 
follows. At block 520 it is determined if there is a 
sufficient number of free pages in the free, non-pinned and 
pinned regions combined. If not, the memory allocation 
fails (block 522) and a suitable message is sent. But if a 
15 positive determination is made at block 520, then block 536 
follows. At block 536 pages from the end of the non-pinned 
region 110 are moved to unoccupied pages within the non- 
pinned region. Further, at block 538, a sufficient number 
of pages are moved from the end of the non-pinned region to 
20 unoccupied pages within the pinned region to generate a 
number of free pages within the free region 120 that is 
adequate to satisfy the received pinned memory allocation 
request. It will be appreciated that the movement of non- 
pinned pages at blocks 536 and 538 serves to widen the free 
25 region 120. Following block 538 is block 540. At block 540 
the end of non-pinned region pointer 140 is updated to 
exclude the pages moved at steps 536 and 538. Then, at 
block 542, the pages needed to satisfy the received pinned 
memory allocation request are allocated from the now widened 
free region 120. Following 542 is block 544. At block 544 



30 
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the end of pinned region pointer 150 is updated to include 
the pages allocated at block 542. 

Block 514 follows block 544. At block 514 the 
allocated physical pages are mapped to the virtual memory 
space that was allocated at block 502. 

From the foregoing discussion of FIGS. 5A-5D, it 
will be understood that pinned memory requests are allocated 
only from a suitable hole in the pinned region or from the 
free region at a point adjacent the pinned region. A hole 
in the pinned region may be cleared of non-pinned pages, or 
the free region may be widened, to accommodate the pinned 
memory request. Widening the free region is performed by 
moving non-pinned pages from the end of the non-pinned 
region to holes in the non-pinned region and in the pinned 
region, with holes in the non-pinned region preferably being 
filled first. 

In addition to the memory allocation request 
handling procedures of FIGS. 4A-4B and 5A-5D, the present 
invention may also call for a process to be carried out in 
background to compact the non-pinned region 110. This 
compacting procedure may be performed in accordance with 
conventional practices and will be briefly described with 
reference to FIG. 6. FIG. 6 is a flow chart showing the 
compacting procedure. Initially, at decision block 602 in 
FIG. 6, it is determined whether there are any holes in the 
non-pinned region. If so, block 604 follows. At block 604 
one or more memory blocks are moved from the end of the non- 
pinned region to fill holes in the non-pinned region. The 
holes are filled starting from the front of the non-pinned 
region. Then, at block 606, the end of non-pinned region 
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pointer 140 is updated to reflect the movement of the memory 
blocks from the end of the non-pinned region. 

To summarize, the present invention calls for a 
pinned memory region at one end of the physical memory 
5 space, a non-pinned region at the opposite end of the 

physical memory space and a free region defined between the 
pinned and non-pinned regions. By suitable procedures to 
maintain these regions, and particularly to maintain the 
free region as large as possible, fragmentation due to 
10 pinned memory blocks in minimized, and all available memory 
resources are used efficiently. Due to the presence of the 
free memory range, opportunities for accommodating large 
pinned memory allocation requests are maximized. 

The foregoing description discloses only the 
15 preferred embodiments of the invention; modifications of the 
above disclosed apparatus and methods which fall within the 
scope of the invention will be readily apparent to those of 
ordinary skill in the art. For example, in the pinned 
memory allocation request handling procedure of FIGS. 5A-5D, 
20 priority is given to clearing and then filling holes in the 
pinned region that are occupied by non-pinned pages, rather 
than placing pinned memory allocations in the free region at 
the end of the pinned region. In other words, a preferred 
embodiment of the invention places block 506 ahead of block 
25 516. However, the order of these two blocks can be 

reversed, so that if there is space available in the free 
region the pinned memory allocation request is accommodated 
therein, rather than clearing occupied holes in the pinned 
region. The preferred procedure, in which occupied holes 
30 are cleared in preference to using the free region, provides 
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for greater compaction of the pinned region, but at the cost 
of lower processing performance. 

While the present invention has been disclosed in 
connection with preferred embodiments thereof, it should be 
5 understood that other embodiments may fall within the spirit 
and scope of the invention, as defined by the following 
claims . 
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